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Abstract. In this paper we show that the leading coefficient /i(y, w) of certain 
■ Kazhdan-Lusztig polynomials P y ^ w of the permutation group 6 n of 1,2 



are not greater than 1. More precisely, we show that the leading coefficients 
)i(y,w) are not greater than 1 whenever a(y) < a(w), where a : &„ — > N is 
the function denned in [LI]. See 1.5 for a simple interpretation of the function 



a. 



The Kazhdan-Lusztig polynomials of a Coxeter group (W, S) play a central 
role in Kazhdan-Lusztig theory. From the seminal work [KL] one sees that the 
leading coefficient /i(y,w) of some Kazhdan-Lusztig polynomials P y<w are of great 
importance. It is certainly interesting to understand the leading coefficients. We 
have two natural questions, (a) determine the leading coefficients fi(y,w), (b) for a 
given element w in the Coxeter group, determine all y such that fi(y^ w) or )i(w, y) 
' is non-zero. By now, for both questions we do not have much understanding except 

t^J- . for some special cases, see for example [L4]. 

' In this paper we are concerned with question (a) for the permutation group 

r-j ■ & n of 1,2,. ..,n. We shall show that for y, w € 6„, if y < w (Bruhat order) and 

a(y) < a(w), then the leading coefficient fj,(y,w) is less than or equal to 1, see 

S Theorem 1.4, here the function a : 6 n — > N is defined by Lusztig in [LI], see 1.5 
for a simple interpretation of the function for 6„. When a(y) > a(w), McLarnan 
£> . and Warrington have showed that /j,(y,w) can be greater than 1, see [MW]. The 

' work [MW] gives a negative answer to the (O,l)-conjecture in [GM, p. 52]. 

In this paper we also give some discussion for the set of all /i(y, w), y,w £ & n , 
see section 1.2 and 3.2. 

1. Preliminaries 

In this section we collect some terms and basic facts, we refer to [KL] for more 
details. 

1.1. Let (W,S) (S the set of simple reflections) be a Coxeter group. We shall 
denote the length function of W by I and use < for the Bruhat order on W . 

Let H be the Hecke algebra of (W, S) over A = Z[<p } q~ 2 ] an indeterminate) 
with parameter q. Let {T w } w ^w be its standard basis. There is a unique ring 
homomorphism T : H —* H such that T w = T~l t and (p = . 

In [KL1], Kazhdan and Lusztig proved that for each w in W, there exists a 
unique element C w in the Hecke algebra H such that (1) C w = C w , (2) C w — 
q~~^ J2 y <w Py,wT y , where P y , w is a polynomial in q of degree less than or equal 
to ^(l(w) — l(y) — 1) for y < w and P w , w = 1. 
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The basis {C w } w ^w of H is the Kazhdan-Lusztig basis. The polynomials P VyW 
are the Kazhdan-Lusztig polynomials. If y < w, we have 

P y ,w = ^{y, + j ower d e g ree terms. 

We write y -< w if /j,(y, w) ^ 0. 

1.2. Assume that (W, S) is an affine Weyl group or a Weyl group. The following 
formula is due to Springer (see [Sp]), 

(a) n(y,x) = S y-\x,d+ H %~\x,Mf) = $y,x-\d+ 7y,x-\Mf)- 
dev Q fev t dev fev ± 

We need explain the notations. Write 

C x C y = ^ h x , y , z C z , h XiViZ € A = Z[qi,q~*]. 

Following Lusztig ([LI]), we define 

a{z) = min{i G N | q~%h x , y , z G Z[g~^] for all x,y G W}. 

If for any i, q~^h XtVtZ £ Z[q~^] for some 1,56 W, we set a(z) = 00. It is not clear 
that whether there exists a Coxeter group (W, S) such that a(z) = 00 for some 
z G W. 

From now on, we assume that the function a : W — > N is bounded and (W, S 1 ) 
is crystallographic. In this case, the function a is constant on two-sided cells of W 
(see [LI]). Obviously, when W is finite, the function a is bounded. Lusztig showed 
that the function a is bounded for all affine Weyl groups (see [LI]). Following 
Lusztig and Springer, we define 6 x , y , z an d Jx, y ,z by the following formula, 

q(z) a(z)-l 

h x , y ,z = lx,y,zQ 2 + S x ,y, z q 2 + lower degree terms. 

Springer showed that l(z) > a(z) (see [L2]). Let S(z) be the degree of P e . zi 
where e is the neutral element of W . Then actually one has l(z) — a(z) — 2S(z) > 
(see [L2]). Set 

Vi = {z G W | l(z) - a(z) - 26(z) = i}. 

The number n(z) is defined by P e z — "^(z)^ 2 ' + lower degree terms. 

The elements of T> are involutions, called distinguished involutions of (W, S) 
(see [L2]). Moreover, in a Weyl group or an affine Weyl group, each left cell (resp. 
right cell) contains exactly one element of T>o, see [L2]. When W is a Weyl group, 
Lusztig has showed that an element z is in T>i if and only if there exists some d in 
T>o such that z ~ d and fj,(z, d) ^ or /j,(d, z) ^ 0, see [L3]. For & n , all involutions 

L R 

are distinguished. 

Example: Let S' be a subset of S such that the subgroup W of VF generated 
by S' is finite. Then the longest element of W' is in T> . 

1.3. We refer to [KL] for the definition of the preordcrs <, <, < and of the 

L R LR 

equivalence relations ~, ~, ~ on W. The corresponding equivalence classes are 

L R LR 

called left cells, right cells, two-sided cells of W, respectively. The preorder < 

L 

(resp. <; < ) induces a partial order on the set of left (resp. right; two-sided) cells 

R LR, 

of W, denoted again by < (resp. <; < ). For a Weyl group or an affine Weyl group, 

L R LR 

Springer showed the following results (a) and (b) (see [Sp]) 
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(a) Assume that jj,(y, w) or n(w, y) is nonzero, then y < w and y < w if a(y) < a(w), 

L R 

and y <~ w or y ~ w if a(y) = a(w). 

Z, R 

(b) If <5a;,y jZ 7^ 0, then z ~ y or z <~ x. (Note that ft-a;,y,z 7^ implies that a(z) > a(x) 

L R 

and a{z) > a(y), see [LI].) 

For w G W, set L(w) = {s G 5 | sw < w}, R(w) = {s G S \ ws < w}. Then 
we have (see [KL]) 

(c) R(w) C R(y) if y < w. In particular, R(w) = R(y) if y ~ w; 

l L 

(d) L(w) C L(y) if ?/ < w. In particular, L(w) = L(y) if y ~ w. 

r R 

We shall need the star operation introduced in [KL]. Let s and t be in S such 
that st has order 3, i.e. sts — tst. Define 

Dl(s, t) = {w G W I £(u>) n {s, t} has exactly one element}, 

Dr(s, t) — {w G W R(w) n {s, i} has exactly one element}. 

If w is in I?L(s,t), then {sw,tw} contains exactly one element in DL(s,t), 
denoted by *u>, here * = {s,t}. The map: (p : DL(s,t) — > Dl{s,£), w — > *w, is an 
involution and is called a left star operation. Similarly if w G Dr{s, t) we can define 
the right star operation ip : Dn(s,t) — > Dn(s,t), w — > w* = {ws, wi} PI Dji(s,t), 
where * = {s,i}. The following result is proved in [KL]. 

(e) Let s and t be in S such that st has order 3. Assume that y -< w. If both 
y* and u>* (resp. *y and *w) are well defined , then either (1) y* -< w* and 
/i(y,w) = fj,(y*,w*), or (2) w* ~< y* and fj,(y,w) — n(w*,y*) = 1 (resp. either (1) 
*y -< *w and ^(y, w) = n(*y, *w), or (2)*w ~< *y and fi(y, w) = n(*w, *y) = 1.) 

The main result of this paper is the following. 

1.4. Theorem. Let y,w G 6„. If ?/ < w and a(y) < a(w), then the leading 
coefficient n(y,w) is less than or equal to 1, here the function a : 6 n — > N is 
defined in 1.2. 

Remark. This result is also true for an affine Weyl group of type A n -\. 

1.5. For W — & n , there is a nice description for cells of W, called Robinson- 
Schensted rule. We recall the rule since it also provide a simple way to compute 
the function a : & n — > N defined in subsection 1.2. As usual, the set S consists of 
transpositions Si = + 1), i = 1,2, n — 1. 

A partition A of n is visualized as a Young diagram F\ with n boxes such that 
the lengths of the columns of the diagram are given by the components of A. A 
Young tableau of shape A is a labelling of the boxes of F\ with integers l,2,...,n. 
The tableau is called standard if the numbers labelling its boxes are increasing in 
the columns from the top to the bottom and are increasing in the row from left to 
right. The Robinson-Schensted rule gives a bijection 9 : w — > (P(w), Q(w) from the 
permutation group & n to the set of pairs of standard Young tableau on {1, 2, n}. 
Let w(i) = ji for i — 1,2, ...,n. The standard Young tableau P(w) is defined as 
follows. 

Let To be the empty Young tableau. Assume that we have defined a Young 
tableau Ti_i which has totally i — 1 boxes and the boxes are labelled with integers 
ji,j2,...,ji-i- Now we define the Young tableau T^. If ji is greater than every 
numbers in the first row of Tj_i, then Ti is obtained from Ti_i by adding ji to the 
end of the first row of Tj_i. If not, then let z be the smallest number of the first 



4 



N. XI 



row of Ti-i greater than ji. Let T(_ 1 be the Young tableau by removing the first 
row of Ti-\. Then Tj is the Young tableau obtained from Tj_i by replacing z by 
ji and by inserting z to the tableau T[_ x as the same way. It is known that P(w) 
is indeed a standard Young tableau. We set Q(w) = P(w^ 1 ). Let y, w be in & n , 
then we have (see [BV]) 

(a) y ~ w if and only if Q(y) = Q(w), 

(b) y ~ w if and only if P(y) = P(w), 

R 

(c) y ~ w if and only if P(y and P(w) have the same shape. 

LR 

Assume that P(w) is a Young tableau of shape A = (Ai > A 2 > • • • > Xk) 
(a partition of n). we define a(w) to be \ Yli=i ^»(^» — !)■ Then a : &„ — > N is 
exactly the a-function defined in 1.2. 

Note that y < u; if and only if X(y) < X(w), where X(y) and X(w) are the 

LB 

partitions corresponding to P(y) and P(w) respectively. (We say A = (oi, a 2 , ...) < 
/i = (61, 6 2 , ...) if 01 H h a fc < 61 H h 6 fe for all k = 1, 2, ....) 

2. A description of the set of all /j,(y, w) for 6„ 

In this section we give a description to the set of all /j,(y,w), y,w £ 6„, in 
terms of S XyVyZ} x,y,z £ 6 n . More precisely, we have 

Proposition 2.1. For & n , the set {S x>ytZ \x,y,z £ & n } is equal to the set 
{n{y,w)\y,w £ & n }. 

Proof: Clearly both sets contain 0. Assume that n(y,w) is non zero. By 
Springer's formula 1.2(a), we have S y -i_ w _ d ^ for some d £ T> or "y y -i iWiU ^ 
for some u £ T>\. It is no harm to assume that a(w) > a(y). If a(w) > a(y), then 
ly- 1 ,w.u = for all u in 6„ (see [LI, 6.3(a)]), and 5 y -i_ w _d 7^ implies that d and w 
are in the same left cell, cf 1.2 (c) and [LI, 6.3(b)]. Therefore fi(y,w) = S y -i iW ^ w ^ 
in this case. (We use d{x) for the unique element in T>q which is in the left cell 
containing x.) If a(w) = a(y), by 1.3 (a), then w and y are in the same left cell 
or in the same right cell. It is no harm to assume that y, w are in the same left 
cell since /j,(y,w) = ^(y^ 1 ,w _1 ). Then y,w are in different right cell (cf [KL,§5]. 
This implies that j y -i tWtU = for all u £ & n (see [LI, 6.3(a)]. If 5 y -i tWt< i ^ 0, then 
d = d(w). Thus in this case we still have n(y,w) — 5 y -i, w Mw)- 

Conversely, assume that 5 x ,y,z 7^ 0. It is no harm to assume that a(y) > a(x). 
Then y and z are in the same left cell, cf 1.2 (c) and [LI, 6.3(b)]. Thus we can 
find a sequence of right star operations ip/,, <Pi such that ipk • ■ • <fi(z) — d is in 
T>o, see [KL, §5]. By a similar argument as for [X, Prop. 1.4.4(b)], we see that 
h x , y ,z = h x . y i yd , here y' = ipk ■ ■ ■ <pi (y) ■ In particular we have S Xt y tZ = 8 x ,v',d- If 
a(y) > a(x), by Springer's formula 1.2 (a), the value 5 Xyy > y d is equal to /i(a; _1 ,j/') 
or /j,(y' , x^ 1 ). If a(y) = a(x), then d and x are in the same right cell, d and y' are 
in the same left cell. So x,y'~ are in the same right cell and are not in the same 
left cell. Thus 7 x ,j/',u = for any u (see [LI, 6.3(a)]. In this case we also have 
5x,y',d = ^{ x1 tV') or 5x,y',d = x^ 1 ). 

The proposition is proved. 

In the proof we see the following 
Corollary 2.2. If a(y) > a(x), then 6 x>y>z = 5 x , y ',d = ^{x^.y') or ^(y'.x^ 1 ) for 
some y' in the right cell containing y and some d in T>q. 

When y and w are in the same two-sided cell we have the following result. 
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Proposition 2.3. The set {n(f)\f G V{\ is the same as the set {/j,(x,y)\x ~ 
y and fj,(x,y) ^ 0}. 

Proof: If fi(x,y) =/= and x and y are in the same two-sided cell, by 1.3 (b) 
and [LI, 6.3], x and y are in the same left cell or in the same right cell. It is no 
harm to assume that x and y are in the same left cell. By Springer's formula 1.2 
(a), S = 5 Xt y-iM y -i-\ ^ or 7 = J XiV -ij =/= for some / G T>\. Since y and w 
are not in the same right cell, we have (5 = and 7 7^ 0. Note that 7 x ,y- 1 ,f 
implies that / <~ x and / ~ y^ 1 , see [LI, 6.3]. Such / is unique. Moreover, using 

R L 

[X, Theorem 1.4.5], [KL, §5] and [L2, 1.4(a)], 'y x ,y- 1 ,f = 1 in this case. Therefore 
fj>(x,y) = 7x,2/- 1 ,/ 7r (/) = The proposition is proved. 

For simplifying statements, in the rest of this section we set ji{y,w) = /j,(w,y) 
whenever one of n{y,w), jj,{w,y) is defined. Note that we have /«(/, d(f)) = 
7/,d(/),/ 7r (/) = Thus we have 

Corollary 2.4. The set {[i(x, y)\x <~ y and n(x,y) ^ 0} is the same as the set 

LR 

Mf,d)\f ez>i,de A), and / ~ d, /x(/,d) ^ 0}. 

2.5. Let /, x G <3„. If x ~ / and 7^ 0, then ir ~ / and a; ~ /. Thus we must 

ii? L R 

have x = f, since in a two-sided cell of 6 n , each left cell and each right cell have 
exactly one common element. Let M/ be the irreducible module of if (gu Q(<p) 
provided by the left cell of 6 n containing / (cf, [KL] ) . Then we have 

hf,f,f = tr{Cf,M f ). 

By [X, Prop. 1.4.5 (b)], we see that hfjj — hf t d,d, where d G T>o and d <~ /. Thus 
Sfjj = fi(f,d). Therefore we also have {/i(x,y)\x ^ y} ~ {$fj.f\f € & n } (we set 
fi(x, x) = 0). 

3. Proof of Theorem 1.4 

3.1. Now we can prove the main result. Let y < w be elements in & n such that 
a(y) < a(w) and n,(y, w) ^ 0. 

By 1.3 (a), we have y < w and y < w. Thus L(y) is a subset of L(w). If 

there is a simple reflection s in L(w) — L{y), then Py !t0 = P S y,w and the condition 
fj,(y,w) 7^ forces that sy = w and /j,(y,w) = 1. Now assume that £(u>) = L(y). 
According to [KL, §5], there exists some subset J of {1, 2, n— 1} and a sequence 
ifi,...,(pi of left star operations such that ipt ■ ■ ■ ipi(w) <~ w/. (We use W/ for the 

R 

subgroup of & n generated by all Sj, i E I, and denote by the longest element 
of Wj.) For j = 1, 2, i, set = ipj ■ ■ ■ fi(w) and set wq = w. 

Let k be the maximal number among l,2,...,i such that yj = ipj ■ ■ ■ <fii(y) is well 
defined for all j = 1, 2, k. Set y = y. If for some 1 < j < k, we have Wj < yj 
and y m < w m for m = 0, l,...,j — 1, using 1.3 (e) we see that 1 = fj,(wj,yj) — 

Mi/j-i.Wj-i) = v{y,w). 

Now assume that yj < for all j = 1, 2, ...fc. Using 1.3 (e) we get n{yk,Wk) = 
jj,(y,w). We claim that L(wk) — L{yk) is non-empty. Since a(yj) = a(y) < a(w) = 
a(wj) for all j = 0, 1, 2, k, we always have L(yj) C L(wj) for all j. If fc < i, the 
set L{wk) — L{yk) must be non-empty. Otherwise, we must have L(wk) = L{yk). 
Thus y/c+i = tpk+i{yk) is well defined. This contradicts the assumption on k. When 
k = i, we have L(wk) = {sj\j G /}. If L(wk) C L(yk), then we can find j/ such that 
2/fc = w/V and = Thus a(y) = a(t/fe) > a(wi) = a(w k ) = a(w). A 
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contradiction. Therefore in this case we also have that L(wk) — L(yk) is non-empty. 
We then must have l(wk) = l{yk) + 1 and fi{yk,Wk) — n(y 7 w) = 1. 
The theorem is proved. 

Remark. Using the result [S, Lemma 18.3.2] and a similar argument as above 
one can prove that Theorem 1.4 remains true for an afhne Weyl group of type A n _i. 

Proposition 3.2. For & n , n > 4, the set w)\y, w G & n } is equal to the set 

{v{y,w)\y,w G &n and a(y) > a(w)}. 

Proof: Clearly when n > 4, 1 is in the set A = {/i(y,w)\y,w G & n and a(y) > 
a(w)}. By Theorem 1.4, we only need to show that if a(y) — a(w), then fi(y, w) is 
in A. To do this we need some preparation. 

Let U = Uq be the subgroup of & n generated by s 2 , S3, s„_i. For i = 
1, 2, ...,n — 1, we set C/, = Sj • • ■ S2S1C/0 and f/ t ? = U0S1S2 • • • Sj- Then ?7j n C/j = if 
z ^ j and S„ = ?7o U U\ U • • • U XJ n -\- Moreover if w is in Uo, then the length of 
Si ■ ■ ■ s 2 siw is l(w) + i. The following assertions (a) and (b) are easy to prove. 

(a) Let y & Ui and w G Uj. If y < w, then i < j. 

(b) Let y = Sj • • • S2Siyi and w = Sj • • • S2S1W1 be elements in C/j. Then = 
p 

For a subset 7 of {1,2, ...,n — 1}, let Wj be the subgroup of & n generated by 
Si, i G 7 and w/ the longest element of Wj. 

Let 7 = 7i U 7 2 U • • • U 7 m be a subset of {1, 2, n — 1}. Assume that Ii = 
{1, 2, fci} and 7j = {kj-i + 2, + 3, kj} for j = 2, 3, m. Then wi = 
io/jJO/j • • • tt7j TO . Assume that ki + 1 > ki — k\ > k^~k2 > • • • > fc m — fc TO _i > 1. The 
shape of the Young tableau P(wi) is A(w/) = (fci + 1, fc 2 — fci, k m — k m -i, 1, 1). 

According to 1.5 and [KL, §5], we have 

(c) for each element uo in & n we can find a unique subset 7^ of {1, 2, n — 1} as 
above such that w £ J R w i ano - can ^ n( i a sequence ipi, yi of left star operations 
such that ipi - ■ - ipi (w) <~ w/. 

Now we claim the following assertion. 

(d) Let 7 be as above and w ~ w/. Then w is in 7/^1 ■ 

We argue for (d). Let j be such that w is in C7,-. Clearly we have j > k\. 
If j > fci, then j = fc a for some 2 < a < m and w = SjSj-i ■ ■ ■ S2S1W1 for some 
w\ G J7. Let u = Sfe _ 1+ 2Sfe _ 1 +3 • • • SjW. Then w < u and Sfe a _ 1+ iu < u. Clearly 

Li? 

for any i in 7i U 7 2 U • • • U 7 Q _i U 7 a+i U • • • U 7 m , we have s i s fea _ 1+2 s fea _ 1+3 ■ • • sj = 
Sfe a _ 1+2 Sfe a _ 1+3 • • • SjSi. Thus, for these i we have SiU < u. It is easy to check that 
for i in I a — {fc a _i + 2}, we have SiU < u. Let 

J = h U 7 2 U • • • 7 a _ 2 U (J„_i U {fc a _i + 1}) U (7 a - {fc a _! + 2}) U 7 a+1 U • • • U 7 m . 

Then u = for some ui with l{u) = l(wj) + l(u\). Thus a(u) > a(wj) — 

a(wj) + 1 + (fc a -i — fco-2) — (k a — fca-i) > ft(wj) + 1 ( wc set fc-i = — !)■ This 
contradicts a(u) < a(w) = a(wj). Therefore (d) is true. 

Now wc can complete the proof of the proposition. Assume that a(y) — a(w). 
Then y ~ w or y ~ 10. It is no harm to assume that y ~ w since w) = 

L R R 

Also we may assume that jj,(y,w) > 1. Since a left star operation 
sends a right cell to a right cell with the same a-function value and it keeps the value 
of the /j,(y, w) (see 1.3(e)), it is now harm to assume that y ~ w ~ w/, where 7 is as 

in (d). By (d), wc know that both y and w are in U^- Set y = s^ ■ ■ ■ S2SiJ/i and 
io = Sfcj • ■ ■ S2S1W1. Then yi and w\ are in [/. By (b), we have fj,(y,w) = n{y\,w\). 
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If a(yi) < a(w\) or a(y\) > a(wi), we are done. If a{y\) = a(w\), continuing the 
above process or using induction on n, we see that /j,(y, w) is in A. 
The proposition is proved. 

Here is a question. For y < w in 6„ with /i(y, w) ^ and a(y) > a(w), whether 
we can find y' and w 1 in some & r such that y' ~ w' and rt(y, w) = fi(y' , w'). 

LR 

3.3. Using 1.5 (b) we get the following assertion. 

(a) Let w be in & n and / be as (d) of the proof of Proposition 3.2. Then w ~ wi 

R 

if and only if the following conditions are satisfied: 

(1) For ki-i + 2 < f < g <ki (set k = -1), we have w~ 1 (f) > w~ 1 (g). 

(2) For each 1 < / < n, we have \w(Ii) n {1, 2, /}| > \w(I i+1 ) n {1, 2, /}|. (We 
set 7 TO+ j = {fc m + j} for 1 < j < n - k m .) 

(b) By means of (b) in the proof of Proposition 3.2 we see easily that /j,(y, w) < 1 
if y < w and a{w) = 1. 
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